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Abstract 

We give a criterion for unlimited growth with positive probability for a 
large class of multidimensional stochastic models. As a by-product, we 
recover the necessary and sufficient conditions for recurrence and tran¬ 
sience for critical multitype Galton-Watson with immigration processes and 
also significantly improve some results on multitype size-dependent Galton- 
Watson processes. 
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1 Introduction 


We study conditions on possible unlimited growth for sequences of random vec¬ 
tors Xn, taking values in which verify the stochastic difference equation 

Xn+l = XnM + g {Xn) -|- j £ Nj (1) 

where M is a non-negative primitive d x d matrix, g : —)• is a function 

such that ||5(£c)|| = o(||®||) when ||a;|| tends to infinity, and {^n) is a sequence of 
random vectors (taking values in such that almost surely 

E = 0 

where {Xn, n G N} is the natural filtration associated to (W„). We assume that 
G and that random vectors are such that for all n, Xn takes values 
in almost surely. 

The Perron-Frobenius Theorem [121 pp. 3-4] states that M has a positive 
Perron root p (which is also the spectral radius of M). We call X^ “subcritical” 
if /9 < 1, “supercritical” if p > 1 and “critical” if p = 1. In the “subcritical” 
case, one has P(||W„|| —> oo) = 0 because ||^n|| is bounded in mean. In many 

n—)-oo 

applications, one has P(||W„|| —> oo) > 0 in the “supercritical” case. This 

n—)-oo 

is well-known for the multitype Galton-Watson process with immigration, for 
instance. However, this is not necessarily the case in our general framework. For 
example, if g{Xn) = 0 and = XnM^ with M„ independent and identically 
distributed random matrices such that P(M„ = M) = P(M„ = —M) = 1/2, 
then P(W„ —>■ 0) = 1. 

In this article, we focus on the “critical” case, henceforth p = 1- We define 
the normalized right and left eigenvectors u and v associated to p in such a way 
that vu = u u = 1. 

We assume that the sequence (W„) obeys a weak form of the Markov prop¬ 
erty. More precisely, we assume that E ^ function of Xn and will 

use the notation 

{Xn) = E ((Cn^x)' \Fn) ■ 

The process {Xn) need not be a Markov chain because the law of ^n may depend 
on (Xi,W 2 ,...,W„). However, all our examples are Markov chains. 

The case d = 1 is well understood. The interesting phenomenon is the fact 
that the growth is unlimited depends on both the “drift” {i.e. g{Xn)) and 
the “variance” {Xn)- This was first noticed by Lamperti [10] whose result 
was generalized by Kersting [6]. But, to the best of our knowledge, there is no 
criterion when d > 1. Only particular examples were studied. For instance, 
Klebaner BM gave sufficient conditions for unlimited growth or extinction for 
state-dependent multitype Galton-Watson processes. However, we can build 
some simple processes which do not satisfy his conditions. Gonzalez et al. gave 
also conditions for unlimited growth in the supercritical case in [T]. Jagers and 
Sagitov [3] investigated population-size-dependent demographic processes that 
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are particular cases of multidimensional growth models. Moreover in the critical 
case, they restricted themselves to bounded reproduction and bounded “drift”. 

The aim of this article is to obtain a criterion in any finite dimension that is 
analogous to the one in dimension one, which is our main result. The strategy of 
the proof is the same as in Kersting’s article [6]. We shall illustrate our criterion 
with several classes of examples, notably the one studied by Klebaner [9] for 
which we get a complete picture (except for a very special case). 

Under technical assumptions on functions g and we prove in this article 
that the process stays bounded a.s. if 


lim sup 

r^+oo 


2rg {rv) u 
cj2 {rv) 


< 1 , 


while it tends to infinity with positive probability if 


r^+oo (T^ {rv) 


(2) 

(3) 


This criterion is reminiscent of the criterion in Kersting’s article in unidimen¬ 
sional models. In fact, the matrix M preserves the component of along the 
direction v whereas it contracts along others directions. 

In Section 2, we give our main result and its proof. We apply it in Section 3 
to recover a recurrence-transience criterion for critical multitype Galton-Watson 
processes with immigration and to improve a criterion of almost-sure extinction 
for state-dependent multitype Galton-Watson processes. In the last section, we 
prove some lemmas which are used in the proof of Theorem I. 


2 Criterion for unlimited growth 

2.1 Assumptions 

For a row vector x, let 

y = x{\ — uv). 

We assume that there exist a real number a such that — 1 < a < 1, some 
positive real numbers Cj, dt and some real values functions fi and hi defined on 
M'’*, i G {1, 2}, such that 


g{x)u = Cl (ecu)" -t hi {y) -t fi {x) 
{x) = di -t /i 2 {y) + f 2 {x) 


(Al) 


for all X G M^, with /ii = 0 if a < 0 and 


'\hi {y) I < C 2 II 2 /II" 

\h2 {y) I < 

fi {x) = o((®ti)“) when ||®|| —)• -|-oo 
/2 {x) = o () when ||®|| —)• -too. 
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where ||.|| stands for the euclidean norm. 

We assume that there exist 5 > 0 and > 0 such that for all n € N and for 
all Xn G 

E ((Ilen||)'+^ \Xn) < (X„). (A2) 

We also need the following condition of unboundedness 

VC > 0,3n G N such that P {XnU > C) > 0. (A3) 

Finally, we need two more assumptions on function g and to obtain pos¬ 
sible unlimited growth for Xn- Firstly, that g{x)u is bounded away from 0: 
There exists si > 0 such that for all a,b > 0 such that si < a < b < oo, if 
XU G (a, b) then 3e > 0 such that 


g{x)u > e. 


and secondly, that cr^ is not inhnite : 

Va > 0, sup cr‘^{x) < oo. 
Il®ll 


(A4) 

(A5) 


2.2 Main theorem 

We now give the criterion of unlimited growth for Xn- 

Theorem 2.1 (Unlimited growth criterion). 

We assume (HU) and ()A2p . 

i) If Cl < ^ then P (|| W„|| — >• -|-oo) = 0. 

ii) If Cl > ^ and ()A3D . (lA4p and ()A5D hold then F {\\Xn\\ +oo) > 0. 

Compared to ([2]) and ([3|) , we give a criterion in the special case where g has 
a dominant term in {xu)°‘- This may seem restrictive, nevertheless most of the 
applications deal with a = 0, which means that g is bounded by a constant. The 
case Cl = ^ remains unexplored except for critical multitype Galton-Watson 
processes with immigration under some moment assumptions (see remark in 
Section 3). 

2.3 Proof of the theorem 

The strategy of the proof of the theorem consists in showing that there exist an 
integer k and a real-valued function L such that 

E {L {Xn+kU) \Fn) < L (XnU) 

when XnU is larger than some constant. Then we build a supermartingale and 
proceed by using the martingale convergence theorem. 

Before proving the theorem, we state two key lemmas providing us Lya- 
pounov function. The proofs involve some technical computations and are de¬ 
ferred to Section 01 
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Lemma 2.1. Let us assume (Al) and (A2). If ci < then there exists s > 0 
and A: S N* such that, 

E (log {Xn+ku) \Tn) < log {XnU) , if XnU > S. 

Lemma 2.2. Let us assume (Al) and (A2). If ci > then there exists s > 0 
and k gW such that, 

E (L (Xn+kU) \^n) < L (XnU) , if XnU > S, 
with L (x) = (logx)~^. 

Proof of Theorem 1. 

Without loss of generality, we assume that for every n £ N, XnU > 3 almost 
surely (otherwise consider Xn + 3v instead of X„). 
i) We start by considering the case where ci < ^. 

Following [6], let us assume that XnU —)■ +oo with positive probability. Let 
Un = XnkU, then Un —>■ +00 with positive probability, too. Thus there is a 
positive integer T such that 


E 


inf Un 
n>T 


i> S, Un — y +00 I > 0. 


(4) 


Let r = inf{n > T : Un < s} with the convention that r 


Let 




log {Un+T) if n + T < r, 
log {Ur) otherwise. 


+00 if inf Un > s. 

n>T 


Since (Vn) is a positive supermartingale by Lemma f2.ll it converges almost surely 
and we obtain a contradiction with Q. 

ii) We now turn to the case where ci > ^. 

Let s > 0 be large enough, such that the statement of Lemma YI?2\ holds true. 
Let A, B, C and D, four sets defined as follows : 


^ < limsupX^u < s > 

^ T7— -I 


B = 


Rj < oo 


\ limsupX^tt < oo and £ {0,..., A; — 1}, Xnk+iU —> Ri with s < 

^ n—>oo n—^oo 

} 


C = < £ {0,..., A; — 1}, Xnk+iU —> oo and lim supX„fc_|_j_|_irt < oo > 

L n—>oo ^ 


D = < XnU - >• OO >. 

I n^oo ) 


We want to prove that E(I1) > 0. We first prove that P(^ UBL}CUD) = l 
(Step 1). Secondly that E(^) < 1 (Step 2). Thirdly that ¥{B) = 0 (Step 3) and 
we conclude by proving that P(C) = 0 (Step 4). 
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Step 1 ; Let i G {0,..., A: — 1}. Then Ui^n = min (L , L (s)) is 

a non-negative bounded supermartingale which converges almost surely and in 
mean by Lemma 12.21 Therefore, either X^k+iU converges to a number greater 
than s, possibly oo, or limsupX^fc+jU < s. So, P(T U i? U C U Z?) = 1. 

n—)-oo 

Step 2 : Let us assume that P (^) = 1. Then, for all i € {0,..., /c — 1}, Ui^n 
converges to L (s). Since E (min {L {Xn+^iu) , L (s))) < E (min (L {Xnu) , L (s))), 
for all / G N, we obtain 


E (min (L (X^u ), L (s))) > L{s). 


But by definition, min (L {Xnu) , L (s)) < L (s), therefore min (L (X„u) ,L{s)) = 
L (s) a.s. or X^u < s for all n, which contradicts (lA3p . 

Thus, F{BLi C Li D) >0. 

Step 3 : Without loss of generality, let us assume B with i = 0 and let 
R = 2 sup XnU. 

By (lA4p . there exists si < Rq and e > 0 such that for all x such that 
XU G (si, R), g {x) u > e. 

Since X^kU converges to i?o, there exists Nq such that Vn > Nq, X^kU G 
isi,R). 

Thus, we can choose N such that Vn > N, XnU < R and g {Xj\f) u / 0. 
Consider now, 

n 

An = '^giXM+du, 

l=Q 

n 

Mn = 

1=0 

One can check that Mn is a martingale. 

Further, by (IA4p and ()A5p . 


n=0 


Mn)'^ |Tw+n+l^ = An‘^a‘^ (Xw+n) 

n=l 

oo 

n=l 

oo 

(An-An-l) 

n=l 



By a martingale convergence theorem, Mn converges almost surely. Since XnkU 
converges to R, An —>• +oo, and by Kronecker’s lemma 


n 

= o(An) . 

1=1 
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For n > N, we get the contradiction : 

n n 

Xn+lU = XnU + '^g {Xi) U+'^ClU = An + 0 (An) + 00 . 
l=N l=N 

Thus P(i?) = 0, so with positive probability, there exists i G {0,...,/c — 1} 
such that Xnk+iU tends to infinity. Let us prove that this implies that XnU 
tends to infinity. 

Step 4 : Without loss of generality, let us assume that X^kU tends to infinity. 
Let 7 = r > s and n such that n'^ > 2r. 

Let r„ = [nA, (n + 1)^) be a sequence of intervals and N (1) be an increasing 
sequence of stopping times defined by 

N{1) = mi{nN{l — 1) such that X^kU G [n,oo)}. 

By Markov’s inequality, we obtain 

IP {Xj^^n)k+iu < 2r|XAr(„)fcn > rA) 


Hence by Borel-Cantelli lemma. 



Thus, Xnk+iu converges to infinity so F{C) = 0. 

Since F {A(J B U C U D) = 1 and P(B) = P(C') = 0, thus P(H U D) = 1. Since 
P(H) < 1, we have the desired result 

P(i4) = P {XnU —)• oo) > 0. 


< sup P {^N{n)kU < (2r - P) \XN^n)kU G T;) 


l>n 


< 


sup F({^N^n)kuf > {p - 2rf \XN(^n)kU G Ti 

l>n ^ 


J^pioi+l) 

<sup - 

l>n t ^ 


< K‘ 


, 1 




for any r > 0 sufficiently large. 


□ 


3 Applications 

Our applications focus on the case a = 0. This is because we consider population 
models with finite variance of number of offsprings per individual. Thus, a has 
to be of the order of xu and g of the order of a constant. Notice also that all 
models here are Markov chains, although our result is applicable to processes 
that need not be Markov chains. In the particular case of irreducible Markov 
chains, the process has an unlimited growth with positive probability if and only 
if the chain is transient. Conversely, it does not tend to infinity a.s. if and only 
if the chain is recurrent. 
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3.1 Multitype Galton-Watson process with immigration 

A first class of processes governed by the stochastic difference equation ([T]) is 
given by critical multitype Galton-Watson processes with immigration. Kawazu 
[5] gave a criterion of recurrence and transience that he proved by using gener¬ 
ating functions. We recover here the same result. 

Let (Zn) be a critical multitype Galton-Watson process with immigration 
with d types. At generation n, the k-th individual of type i, i G {1,... ,d} and 
k € {1,..., {Zn)j}, gives birth to Xij^k,n individuals of type j, j G {1, • • • ,d}. 
The random vectors {Xij^k,n)je{i,...,d} with i S {1,..., d}, k > 1 and n G N are 
independent with distribution depending only on i. To alleviate notations, we 
write Xij for Xij^i^i. 

We assume that for all i, j G d}, ^{Xij = 0) > 0. Let M = 

(K{Xij)'j.^ be the mean matrix. We assume that M is a non-negative prim¬ 
itive matrix. Since the process is critical, the largest eigenvalue of M is 1. Let u 
(resp. v) the right (resp. the left) eigenvector corresponding to this eigenvalue. 
At each generation n, G N'^ individuals immigrate. The random variables 
An are independent and identically distributed, with P(Ai = (0, ...,0)) > 0, 
lE(Ai) = a and Yar{Aiu) = r^. The random variables An are also independent 
of all variables Xij^k,n- Therefore we have IE(Z„_|_i) = IE(Z„)M -|- a. 

We assume that there exists d > 0 such that for (f, j) G {1,..., d}^, 

E(a2+'5) < +00 and E < +oo. (5) 

Let Tj = (Gov (Ajj, be the matrix of the covariances of off¬ 

spring distributions. Let 

d 

v{z) = J2Yri, 

i=l 

for 2 : S M'^. We obtain the stochastic difference equation 


Zn+l — ZnM -|- a -|- 


with 


d 


— j 'y ^ ^ ^ E {X^ jj^ n)} + An&j E [AnGj) 


i=l k=l 


l<j<d 


where the {^j)je{i,...,d} are the standard unit vectors and 

Ei(^nuf\Xn)=uWiZn}u + T\ 


Proposition 3.1. The process (Zn) is 

• recurrent if 2au < uV{v)u 

• transient if 2au > u V{v)u. 


Remark 3.1. Kawazu obtained the same criterion under weaker assump¬ 
tions: he did not require Vor(^iu) < +oo and ([5]). He also proved that the 
process is null recurrent when 2au = uV{v)u i/E < +oo and 

E (^1 log (Ai)) < + 00 . 

Proof. Firstly, note that 


= uV{Zn)u + = {ZnU)u V {v)u + U V {Zn{I - Uv))u + , 

then recurrence and transience depend on the sign of 2au — u V{v)u. 

Since (jAip is verified with a = 0, ci = au, hi = 0, di = uV{v)u, h 2 {y) = 
u V{y)u, /i = 0 and /2 = and (lASp . ()A4p and (lASp are also verified, we just 
have to check (lA2p to apply Theorem 1. 

Let I G N* and (C/fc)fcg{i ;} be some random variables independent with zero 
mean and such that E < +oo for all /c G {1,. .., 1}. We can apply both 

Marcinkiewicz-Zygmund HD p. 108] and Holder inequalities, i.e. there exists 
-R > 0 such that 


E 



< R E 



< RhE 



Since there are three sums in ||^n||) we now apply three times the latter inequality 
to verify that ()A2p holds: 


Edie 


\2+S 


n\\ n 


T 

•J n 


< 2‘^^^E 


\ 


+ 2‘^+^E(\\An- 


d / d {^n)i 

E EE {^i,j,kW — IE {Xij^k^ri)} 

j=l \i=l k=l 


2+(5| 


2\ 1+f \ 

I T 

K n 


d d i^n)^ 

< 2^+^dm I I E I E E - IE 

j=l i=l k=l 


2+5 


T 

w n 


+ 2^+^E { \\An 


2-\-5\ 


d d 

< Rd^E lEElE {Ziij^k,n - E {Xij^k,n)} 

j=l i=l k=l 


2+5, 


T 

•z n. 


+ 22+'5E(||A„-a||^+'’|j; 


2+(5| 


d d 


iZ^)i 


< R 2 /E E E E - IE iX,j,k,n) 


j=l i=l 


k=l 


+ 22+'5E(||A„-a||"+'’|R„) . 


2+(5| 
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We now apply ([S]) to obtain 


lEdl^r, 


|2+5| 


y^n)<C[Y, {Zn)^ ] + D < C'a^+\Zn), 


v.2=l 


for \\Zn\\ sufficiently large. 


□ 


3.2 State-dependent multitype Galton-Watson processes 

State-dependent Galton-Watson processes were first introduced by Klebaner in 
[7] and Hopfner in [2] . Hopfner compared the probability generating functions of 
these processes with those of critical Galton-Watson processes with immigration 
to obtain a criterion of extinction. However, this idea seems difficult to be 
transfered to the multitype case. Basically this is because we have to alter 
the transitions of the Galton-Watson with immigration process for an inhnite 
number of states and thus we may change the nature of the process (recurrent 
or transient). Klebaner [Slin] defined multitype state-dependent Galton-Watson 
processes for which he only gave sufficient conditions for extinction. In particular, 
he could not treat some range of parameter. In this subsection, we obtain a 
criterion to infer whether there is almost-sure extinction or survival with positive 
probability (except in a very special case). 

Following [9], we define a discrete-time state-dependent multitype Galton- 
Watson process with d types Zn by 

/ d {Zn)i \ 

Zn+1 = I y ^ Xi,j,k,n (-^n) 1 

where Xij^k,n (z) is the number of type j offspring of the kth type i parent when 
the process is in the state 2 : in time n. Given = z, the kth parent of type i 
has a random vector of offspring 

(-^i,l,fc,n {z} ) ■ ■ . ) (■2')) ■> k — 1, . . . , 

For each n € N, the offspring vectors of distinct parents (/c = 1,..., i = 1,... , d) 
are independent. Moreover, for a fixed parental type i, the offspring vectors are 
identically distributed for all n and k, with distribution depending at most on 
the state 2 ;. For the sake of notation clarity, we write Xjj for Let 

M(2) = (E(Jf„(2))),.^„.„ 

be the mean matrix. 

We assume that 

M{z) = M + C{z) 

where M is a non-negative primitive matrix with Perron root 1 and correspond¬ 
ing right and left eigenvectors u and v, with vu = u u = 1, and C{z) is a 
non-negative matrix and we let 


g{z) = zC(z). 
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We assume that 


lim g{z) = D £ 

|| 2||—>+00 

Let Ti{z) = (Cov (Wjj (z), Wjj/ be the matrix of the covariances 

of offspring distributions when the population size is in the state z. We assume 
that for all i € {1,... ,(i}, rj(z) converges to Fj when || 2 ;|| converges to infinity. 
Let 

d 

V{z) = Y,^^^i (^) 

i=l 

be the conditional dispersion matrix of the next generation when the population 
is in the state z. We introduce also the quantity 

d 

V{z) = J2^i^^■ 

i=l 

Then (Zn) satisfies the stochastic difference equation 

Zn+l = ZnM + g (Zn) + ^n, 


with 


d {^n)i 

= I E E (Zn) " E {X,j^k,n {Zn))} 


j&{l,...,d} 


^i=l k=l 

One can easily check that E {in'u\Xn) = 0 and 
E \Fn) = uV{Zn)u = {ZnU)uV{v)u + uV{Zn{\ - Uv))u + /(Z„), 


where the function / is such that f{x) = o(||x||) when ||x|| tends to infinity. 

We assume that there exist 5 > 0 and iF > 0 such that for all i, j G {1,..., d} 
and z G M+, 

E (Wj < K. 

As in the previous example, the assumption ()A2D is a consequence of Marcinkiewicz- 
Zygmund and Holder inequalities. 

We make the usual assumptions when one has in mind a population process: 

0 is an absorbing state and all states in \ {0} communicate. 


Theorem 3.1. 

If 

2Du 

u'V{v)u ^ 

then the process becomes extinct almost surely. 

If 

2Du 

u'V{v)u ^ ^ 

then the process survives with positive probability. 
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We cannot treat the case = 1. 

u V {v)u 

We now illustrate this result by the following example. 

Example. We take the example of a two-type cell division process from [9]. We 
recall that ^ „(z) is the number of children of type j for the A:-th parent of 
type i at generation n when the population is at state Again, we write Xij{z) 
for 

We assume that Xij{z) take values 0 or 1 with probabilities Pij{z) and that 
F{Xi^i{z) = 0,Xi^2iz) = 0) > 0, i e {1,2}. Let bi{z) = F{Xi^i{z) = l,Xi^ 2 iz) = 
1), i G {1,2} and aij{x), i,j G {1,2}, be arbitrary functions non-vanishing for 
X > 0 , such that 


ciai,i(zi) £201,2(21) 

2101,i(zi) 2202,1(22) 2101,2(21) -b 2202,2(22) 

£102,1(22) £202,2(22) 

2101,1(21) -b 2202,1(22) 2101,2(21) -b 2202,2(22)_ 

where p,p' G (0,1) and ci ,£2 > 0. We assume that bi{z) ~ bi when || 2 || tends to 
infinity. 

With the previous notations, we have 

• ^ = = t^) 


M{z) = 


P 1 -P 

p' 1 — p' 


+ 


• Du 


c^ +C 2 

V2 


V{Z) = 21 


p{l-p) bi-p{l-p) 


J)i-p{l-p) p{l-p) 

Corollary 3.1. If 


+22 


p'{l-p') b2-p'{l-p') 

b2-p'(l-p') p'{l-p') 


£1 + £2 < 


p' A I u 


1 — p + p' " 1 — p + p 

then the process becomes extinct almost-surely. 

’I 

1 — p + p' 1 — p + p' 


£1 + £2 > 


then the process survives with positive probability. 


Klebaner in [9] proved almost sure extinction if £1 -b £2 < min( 6 i, 62 ) and survival 
with positive probability if £1 -b £2 > max( 6 i, 62 )- We thus have improved his 
result since we prove that the critical value for ci -b £2 is ^1 + i-p^p' ^ 2 - 

Except for the equality case, we get a complete picture of the fate of the process. 


4 Proof of Lemmas 12.11 and 12.2 

In this section, we prove Lemmas 12.11 and 12.21 The proof is based upon the 
following result. Let 

Yn — Xn {XjiU) V 
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be the population vector minus the contribution along the eigenvector v. For 
later convenience, we set An^k = A^n+kU — XnU. 

Lemma 4.1. Let us assume (Al) and (A2). There exist C 2 > 0 and d '2 > 0 such 
that for all integers n, /c > 1 and for all e > 0 , 


\¥.{Ar,,k\Xn) - Clk{XnUT\ < 4 1|P + O ((X„u)“) , 


^{Al^^\Fn)-kdi {Xnuf+^ 


<4||lF„f+“ + o((X„u)^+“) , 


( 6 ) 

(7) 

( 8 ) 


with 4 = 0 if a < 0 . 

The proof of this lemma is based upon two technical lemmas that we state 
and prove first. 


Lemma 4.2. Let us assume (Al) and (A2). For all a £ ] —1,1[ and n, i £ N, 


E {{Xn+iUr \Xn) = {XnUr + o{{XnUT) , 


and 

E \Fn) = {Xnuf+^ + O . 

Proof. We first prove that 


E {{Xn+iUy \Fn) = {XnUV + O ((X„u)4 , 
for all 7 £ [ 0 , 2 [ whatever the value of a. 

The result is obvious if 7 = 0. We first deal with the case where 0 < 7 < 1. 
Then for all positive real r, (1 + r)^ < 1 + 7 r, we obtain the upper bound 

E {{Xn+iuy \Fn) < E {Xn+lu\Fny < {X^U + Q (X„) uf 
< {XnUy +^g{Xn)u{XnUy-\ 


By using the inequality (1 + ry > 1 — \r\^, that holds for all r > —1, we obtain 
the lower bound 


E [{Xn+iuy \Fn) > E [{Xnuy - \g {Xn) U + inU[^ \Fn) 

> {Xnuy - 2^ {g {Xn) uy - 2^E \Fn) ■ 

Since g {Xn) u = O {{Xnuy) and using 

E \Fn) < E {jCnuf \Fn) ' = O ((X„u)“) 


we get 

E {{Xn+iuy \Fn) = {Xr^uy + O ((X„u)'^) . 

We now deal with the case where 7 > 1. Since for all real r > — 1 

(1 + ry < 1 + 2 ’^“^|rP + 2 '^|r|, 
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we obtain 


E {{Xn+iu)"' \Fn) < {XnUV + 2^-1E (Iff (X„) U + \^n) 

+ 2^ {XnUy-^ E (Iff {Xn) U + inU\ \Tn) 

< {Xnuf + O ((X„n)“) + O ((X„u)^+^) . 

The lower bound is an easy consequence of Jensen’s inequality: 

E ((X„+in)^ \Fn) > E (X„+in|T-„)^ > {X^uf . 

We have proved that 

E ((X„+iu)^ \Fn) = {Xnuf + O {{Xnuy) , (9) 

for 7 G [0, 2[. We will prove that 

W.{f(Xn+lu)\Fn)=o{{XnUf), (10) 

if / is a real-valued function such that /(r) = o{F) when r tends to infinity. 
We recall that /(r) = o [r^) if and only if for all e > 0 there exists Ce > 0 such 
that |/(r)| < er'^ + because 7 > 0 . 

Let / be a real-valued function such that /(r) = o{r'^), e > 0 and Cg > 0 such 
that |/(r)| < -b C^- By Q, 

E(|/(X„+iu)||j;) <E(e(X„+iu)^ + Ce|j;) 

<e{Xnuy+ Ce + eo{{Xnuy) 

< 2e{Xnuy + Ce +Cl. 


Thus, we obtain (fTOjl . Since we get ([9|) and (|10p . the result follows by induction. 

We end the proof with the case — 1 < a < 0. The lower bound is again a 
consequence of Jensen’s inequality: 

¥.{{Xn+lUr\Fn) > {XnUFg{Xn)uT 

> {XnUT + ag{Xn)u {XnuT-^ . 


For the upper bound, we first majorize the probability that Xn+iu is smaller 
than by Markov’s inequality: 


¥(^Xn+lU<^\F^ 


= E ( _ g{Xn)u\Fr, 


< E < E (^(^2 > 

4M [{^nU)‘^\Fn) , \o-l 

- (X„u)^ - ■ 
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Therefore, since for all r > -h (1 + r)“ <1 + 4 "|r|, we obtain 

<r (^Xn+lU < ^\Tn^ 


+ E 




\g{Xn)u + ^nU\ \ 

XnU J 



< {XnUr + 0{{XnUr-^) + OiiXnuf-^). 


We conclude in the same way as above by using that /(r) = o (r“) if and only if 

__ I , , I _ —l-j-d _ 

for all e > 0 there exists Cg > 0 such that |/(r)| < er“ + Cer^~. □ 

Lemma 4.3. Let us assume (Al) and (A2). For all 7 G [0, 2] there exists C > 0 
such that for all /c, n G N 

k-l 

^E (||y„+iP|T-„) < C\\Ynr + o iiXnur). 

i=0 

Proof. We hrst write a recurrence relation for Yn by 


Yn+1=YnM + g{Xn){l- Uv) + (I “ Uv) 

= Yn{AI - uv) + g (Xn) (I - uv) + Cn (I - Uv) 


because YnU = 0. Hence 

i—1 

Yn+i = Yn (M - uv)" + ^ (5 (Xn+j) + Cn+j) (I “ Uv) (M - UVy~^~^ . 

j=0 

The Perron-Frobenius theorem states that the spectral radius A of M — rtu is less 
than 1. Let Ai G (A,l). We recall that by Gelfand’s formula (see O p. 349]), 
we have 

A = lim ||(M-nu)™f/™, 

m^oo 

for any matrix norm. Consequently, there exists a constant C which does not 
depend on i such that we obtain 

I|l^n+|| < C [ A1||1F„|| + ^ (lb {Xn+y II + lbn+,11) 

\ j=0 

Hence, by (fTT)l below, we obtain 

i—1 

iir„+,ir < c2^\i"\\Y^\v +(lb {x^+j) ir + ii^n+bD ■ 

3=0 

Since 

E (lb {Xn+j) ir|.T„) = O ((X„u)“^) and E (|bn+iir|-F„) = O ((X„u)“) , 
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by (IA2p . we get by summation 


k-l 


+ o{{Xnuy) 

i=0 ^ 


□ 


Proof of Lemma We first prove ([6]) : 

The proof is an easy consequence of Lemma 14.21 Lemma 14.31 and (|Alh : 


IE [^ri,k\^n) < E 



( k-l 

Y,Cl {Xn+iuf + C2\\Yn+ir + fl i^n+i) \Xn 

i=0 

< kci (XnUf + C'WYr^r + O ((^nO • 


The same proof with —C 2 instead of C 2 gives the lower bound. 

We now prove inequality ((7|). As for ([6]), the main point is to show that ^2 
does not depend on k. 

By means of Lemma 14.21 Lemma 14.31 and (lAlh , we get 


E {\An,k\‘^\p'n) < E 


< E 


^k-1 


^ ^ {S i^n+i) U + f^ri+iU} 


^i =0 



k-l 

^ ^ iCn+iU) + 


i=0 


^k-1 


^ ^ S i^n+i) ' 


U =0 




< kdi (X„n)^+“ + d2||l^nf+“ + O 


and the proof for the lower bound is similar. We conclude with the proof of ([8|). 
By Markov’s inequality: 


E(|A„ 


nM 

< E ( |A„ t-Pl 






P 

n 


< E 


Xn 


/ \An,k\^+^ 

V (eXr^u)^ 

2+S /k-l 


< 


{2k) 


(^sXnU^ 


E \g (X„+0 u|"+'^ + \in+iU\'^^ I 
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Since E 


{Xn+i)u\'^^^ ~ ^ by Lemma [12] and 




Tn] =0 (X„U 


.l+a+i±2LS 


^ by (IA2p . we obtain 




< 


(2k) 


2+5 


(sXnU)^ 

<e[(k,e) 

which is the desired inequality. 

We now prove Lemmas 12.11 and 12.2 


(ei (k) (X„u)2“+“'5 + 62 (k) 


□ 


Proof of Lemma \2.1[ We first recall an inequality proved in [ 6 ]: If e > 0, x > 0 
and h > —x, then 


1 r \ h\ ^ 1 I ^ ^ ^{h<ex} 

log (x + h) < log X H- 


X 2(1 + £)x2' 


( 11 ) 


Let k G N and e > 0 , both to be fixed later on. We apply inequality (ITT]) with 
X = XnU and h = 

E [log (Xn+kU) \Xn) < 

E(A„,fc|j;) E(|A„,fc|2|j-„) 


log [XnU) + 


+ 


XnU 2 (1 + e) ■ 2{l + £){XnU)^ 

Using inequalities dSD, dZD and dS]) from Lemma lO we obtain 

E (log [Xn+ku) \Fn) < 

Cik [XnU)^ + P^WYnr + O {[XnU)^) 


log (XnU) + 


X nU 


kdi [Xnuf^^ - d' 2 ||r„f+" + O (X 


lU 


1 +a 


2 (l + e) [Xnu)^ 


+ 


2 (l+e) (XnU)^ 


By the Perron-Frobenius Theorem [12] . all coordinates of u are positive. There¬ 
fore, by definition of Yn-, there exists 6 > 0 such that for every n, 


I'F'nll ^ bJC^jU. 


( 12 ) 


We obtain 

E (log [Xn+kU) \Fn) < 

, , cife(X„ur+ c' 26 “(X„n)“ + o((X„nn 

log (XnU) H-—- 

XnU 

kdi (X„u)i+“ - 46^+“ (X„u)^+“ + o O ((X„u)^+“+^^) 

2(l + e) [XnU)^ ^ 2[l+s){XnU)^ 
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We first choose e > 0 such that ci < 2 {i+£) • choose k such that 


k 



di \ 

2(l + e)y 


+ c' 26 “ + 


46^+" 

2 (l + e) 


< 0 . 


Thus there exists s > 0 such that, 


E (log {Xn+kU) \Xn) < log {XnU) , if XnU > S. 


□ 


Proof of Lemma \2.2i We recall another inequality proved in [^. For x >3, let 

L{x) = (logx)"^. 

There exists 6*2 > 0 such that for any x>3, h>3 — x and 0 < <5 < 1 then 

L{x + h)<L{x) + L' (x) h + + C 2 ' ' + 1. (13) 

As in the first case, we prove that E (L (X^+^u) |X„) < L{Xnu) for some 
fixed k and X„u large enough. 

We apply inequality (fOl) with x = XnU, h = A„ ^ and k an integer to be 
fixed later on to get 


E {L {Xn+ku) \Xn) < 

IE [An,k\j^n) 


L (X„.u) - 


+ 


E(|A„,fc|2|j;) 


+ 


2 E(|A„,fc| 2 |X,) 


(X„u)(log(X„u))2 2(X„u)2(log(X„u))' 2(X„n)2(log(X„n))=' 

- ^ l-A^) +e(1|^ 

V {^n,k< - 2-11 J 


{log {X,,u)y {XnUY 
We start with the estimate 




1 


V 


| 2+(5 


22+5 I 


<E ( 2 ^+^ > 


n. 


{XnUY 

that follows easily from Markov’s inequality. We now use the basic inequality 

(o + 6 )^+^ < 2 ^+^ (a^+^ + 6^+5^ , a, 6 > 0, (14) 

and the facts (resnlting from (lAlIl and (IA2[) 1 that there exist some positive real 
numbers A and B such that 

E (|5 {Xn+i) |X„) < A (X„u)“(2+^) , 
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and 


E 


{\^n+iU\^^^ \Fn) < B , 


to obtain the upper bound 


E |A, 


12+5 


\Bn) < ( 2 A:) 2 +^E \g (X „+0 + \^n+^u\^^^ | 

Therefore, there exists C 4 {k) such that 


E 


< C'4(fc) . 


We use the inequalities ([ 6 |), d?]) and ([ 8 |) from Lemma HT] and inequality (fT^ : 
E (L {Xn+ku) \Bn) 

^ , (cifc(X„nr-c'||Wnr+ o((X„nn) 


+ 


+ 


{XnU) {\0g{XnU)f 

{kdi (X„n)'+“ + d'4YX+^ + o ((W„n)i+“)) 


2 [Xnuf (log {XnU)f 


2 (kdi {Xnuf+^ + 411^,111+“ + o 


+ C2 


o (X„,u 


2 (X„n)'(log(X„n))^ 

a — l ; 


J+a+- 


< L [XnU) + 


(log (XnU))^ iXnU)^+^ 

k - ci^ + h '2 


(a-l)( 2 +j) 

+ C^ik) [XnU) 2 


(XnU)^-^ {log{XnU)f 


+ O 


{XnU)^-^ {logXnuf 


Since di/2 < ci, we first choose k such that 

k - ci^ + 62 < 0 , 

with 62 = b^~^°‘d'2l2 + b°‘c 2 - Then there exists s > 0 such that, 
E (L (Xn+ku) \Xn) < L (Xnu) , if > s. 


□ 
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